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0 Apparatus control system using on-screen display. 



0 An apparatus control system in which a control- 
ler (3) and a plurality of terminal devices (6-n) are 
connected via the respective communication control 
units (1) to a common communication path (5). Each 
terminal device is provided with a picture constituent 

information keep section (61 or n1) for keeping 

information related to picture constituent elements 
for each display picture unit The controller includes 
a picture data keeping section (31) for keeping dis- 
play element information such as characters, basic 

3 pictures of a plurality of kinds, and an image gen- 
erating software module so as to produce, based on 
-jjthe information related to picure constituent ele- 
^■ments, a picture to be displayed by use of display 
^ element information. As a result, even when a new 
tenninal is connected to the system, a display pic- 
l^ture can be displayed for a control of the new 
POterminal without requiring the controller to achieve a 
Q modification associted with the new terminal. 

Ul 



Fiat 




Xerox Copy Centre 



1 



EP0 371 719 A2 



2 



APPARATUS CONTROL SYSTEM USING ON-SCREEN DISPLAY 



BACKGROUND OF THE INVENTION 

The present invention relates to a control sys- 
tem using an on-screen display for controlling and 
for monitoring apparatuses based on character 5 
strings and graphic screens displayed on a 
cathode-ray tube (CRT) or the like. 

Recently, as means for achieving an apparatus 
control, there has been broadly adopted an 
infrared-ray remote control system. Particularly, In io 
the field of audio and video apparatuses, almost all 
such control systems are of this type. 

However, the transmitter for the remote control 
in this situation is exclusively used for each ap- 
paratus (e.g. a video tape recorder (VTR) is pro- is 
vided with a remote controller dedicated thereto 
and a television set is associated with a remote 
controller to be exclusive therefor in most cases). It 
is hence necessary to prepare a remote control 
transmitter which is capable of controlling a plural- 20 
ity of kinds of apparatuses to be controlled. These 
days, there has been introduced a remote control 
transmitter of a learning type, which is operative for 
a limited number of apparatus types. Moreover, 
when the number of apparatus types is increased, 25 
there appear disadvantages that a large numtier of 
operation buttons are required and that the size of 
the transmitter itself becomes greater. 

These disadvantages are solved by the follow- 
ing method. 30 

According to such method (JP-A-60-1 32324), in 
a system in which a TV set, a controller, and a 
plurality of terminal devices or terminals are con- 
nected via control tines, the controller displays on 
the TV set control information necessary for the 36 
control of the terminals such that one of the control 
information items thus displayed on a screen of the 
TV set is selected. In the controller, based on a 
selection signal from a remote control transmitter 
and the control information item cunrently displayed 40 
on ttie screen of the TV set by the controller, an 
associated control content is selected so as to 
transmit a control signal to terminals, thereby con- 
trolling the terminal devices. 

This method is advantageous that the operation 45 
is facilitated because the operation is conducted 
while the operator is visually checking the display 
picture and that the control result can be confirmed 
on the display picture. 

However, this conventional method is attended so 
with a disadvantageous feature. Namely, when the 
number of temiinal devices to be connected to the 
system is increased or when the control content of 
terminal devices is to be altered, it is necessary to 
change the display picture for the terminal control 



kept by the controller. 

SUMMARY OF THE INVENTION 

It is therefore an object of ttie present invention 
to provide an apparatus control system employing 
an on-display to solve the problems above. 

Namely, in the apparatus control system, even 
when a terminal is additionally installed or even 
when the control content of a terminal currently 
incorporated in the system is changed, a display 
picture for the control thereof can be displayed on 
the display without requiring the controller to 
achieve the change processing associated there- 
with. 

In order to achieve the object above, according 
to the present invention, there is provided an ap- 
paratus control system using an on-screen display 
comprising a controller and a plurality of temninai 
devices, said terminal devices being connected via 
respective communication control units to a com- 
mon communication path. The controller Is char- 
acterized by including a display section, an input 
section for selecting control information related to a 
terminal displayed on the display section, and a 
control section for processing the selected infonma- 
tion supplied from the input section to send a 
control signal associated with the selected informa- 
tion via the communication control unit to the termi- 
nal and for receiving via the communication control 
unit information related to screen constituent ele- 
ments from the terminal to display on the display 
section a control picture based on the received 
content. 



BRIEF DESCRIPTION OF THE DRAV\nNG 

These and other objects and advantages of the 
present invention will become apparent by refer- 
ence to the following description and accompany- 
ing drawings wherein: 

FIG. 1 is a block diagram schematically 
showing the configuration of an embodiment of ttie 
apparatus control system utilizing an on-screen dis- 
play in accordance with ttie present invention; 

FIGS. 2. 4. 6, and 9 are schematic diagrams 
showing display screens presented on the control- 
ler display section based on display picture codes 
transmitted from terminals to the controller; 

FIGS. 3. 5, 7, and 8 are diagrams schemati- 
cally showing layouts of texts communicated be- 
tween terminals and the controller; and 

FIG. 10 is a block configuration diagram 
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showing the constitution of an alternative embodi- 
ment according to the present invention. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Referring now to the drawings, a description 
will be given of an embodiment of the apparatus 
control system employing an on-screen display 
according to the present Invention. 

The configuration of FIG. 1 includes a commu- 
nication control unit 1 for communicating data be- 
tween the controller and tiie terminals via a com- 
munication path or route in confomfiity with a pre- 
determined communication procedure. 

Reference numeral 2 indicates an input sec- 
tion, for example, a remote control pad for select- 
ing control information related to a terminal dis- 
played on the display section of the controller so 
as to Input the selected information to tiie control 
section of the controller. 

Numeral 3 denotes a control section for pro- 
cessing the selected information supplied from tiie 
input section 2 to send control signals associated 
with the information via the communication control 
unit 1 to a terminal and for receiving via the com- 
munication control unit 1 information related to 
screen constituent elements from the terminal, 
tiiereby displaying on a display section 4 a control 
picture based on the content thus received. 

The information related to the picture constitu- 
ent elements includes, for example, selection in- 
formation to indicate a display element infonmation 
item to be selected, display position information to 
designate a position on the display picture where 
the selected display element information item is to 
be dfsplayed, and color information to denote a 
color to be used for the display of the selected 
display element information item. 

The display element information items include, 
for example, characters, graphic elements such as 
a circular image, a star, a hart image, and an arrow, 
and image generating or drawing software modules 
constituting the software to generate basic graphic 
images such as a circle and a line segment. 

The controller further comprises a display sec- 
tion 4 for displaying the control picture produced 
by the conti-ol section for tiie terminal. 

The controller includes the input section 2, the 
control section 3, and the display section 4. 

The control section 3 is connected via the 
communication control unit 1 to a common com- 
munication path 5. 

Reference nuemrals 6 to n denote terminals 
including a VTR. a CD, and"a VD. which are 
respectively linked via the communication control 
unit 1 to a common communication patii 5. 



The control section 3 includes tiierein a picture 
data keeping section 31. a picture generating sec- 
tion 32, and data processing section 33. 

The picture data Iceeping section 31 keeps tiie 
5 display element information items. 

The picture generating section 32 generates, 
based on information related to the picture con- 
stituent elements from the temninals 6 to n. pictures 
to be displayed by use of the display element 
10 infonnation items kept in the picture data keeping 
section 31. This processing may be implemented, 
for example, by use of an image generating pro- 
gram. 

The data processing section 33 processes in- 

75 put information from tiie input section 2 and data 
items from the terminals 6 to n to transfer resultant 
data to tiie screen generate'section 32 and the 
communication control unit 1. thereby achieving a 
sequence control. 

20 The terminals 6 to n respectively include pic- 
ture constituent information keeping sections 61 to 
n1, input/output sections 62 to 6n. and tenminal 
control sections 63 to n3. 

The picture constituent information keeping 

25 sections 61 to n1 keep infonnation items related to 
\he screen constituent elements. These information 
items may be kept therein in units of the display 
picture of the display section 4 of the controller 3 
or may be kept in association with partial regions of 

30 the display picture. 

When the display picture is used as the unit to • 
keep the information, tiie processing to send the 
infonmation to tiie controller is facilitated. When the\ 
partial regions are to be set as the unit, the trans- 

35 mission data is minimized, for example, when a 
portion of the display picture is to be changed. 

The input/output sections 62 to h2 are dis- 
posed to operate tiie associated terminals and to 
display terminal states. 

40 The terminal control sections 63 to n3 process, 
data received from the input/output sections 62 to 
n2 and tiie communication control unit 1 so as. to 
display necessary information on tiie inpuVoutput 
sections 62 to n2. to select and to output informa- 

45 tion related to necessary picture constituent ele- 
ments via the communication control unit 1 to tiie 
controller, and to conti'ol internal operations of tiie 
terminals 63 to n3. 

Next, a description will be given of operations 

50 of the apparatus control system configured as 
above in accordance with the present invention. 

When the system is set up and the controller is 
powered, the display section 4 displays a list of 
connected units as shown in FIG. 2. 

65 This display is accomplished as follows. 

The controller supervises information about tiie 
tyeps or kinds of the tennntnals 6 to n connected to 
tiie communication path 5. 
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For recognizing the types of terminals 6 to n 
connected to the communication path 5, there may 
be adopted a method in which, as described in 
pages 60-61 and page 80 of the Home Bus System 
Specifications, the temninals connected to the com- 
munication path 5 send at the system setup phase 
information items such as the attributes, for exam- 
ple, names and maker names to the controller. On 
receiving the information items, the controller iden- 
tifies the details about the terminals connected to 
the communication path 5. 

Based on the infromation about the terminals, 
the controller displays related information items on 
the display section 4. 

For the display, the layout and other items are 
beforehand detemiined in the controller. The pic- 
ture generating section 32 of the controller gets 
picture data from the picture data keeping section 
31 so as to display the data on the display section 
4. 

Next, an apparatus or a terminal to be con- 
trolled is selected by use of the input section 2. 

The selection may be accompslished such 
that for example, like in an example shown in FIG. 
2. there are used numbers (1 ... TV, 2 ... VTR. 3 ... 
VTR2, 4 ... CD. 5 ... VD) corresponding to the 
respective terminal names. Or. an appropriate cur- 
sor is displayed so as to be moved to a position of 
an objective terminal name, thereby selecting the 
terminal. 

A description will now be given in detail of a 
case where VTR1 is selected. 

When the VTRI is indicated for a selection 
from the input section 2, the data processing sec- 
tion 33 of the control section 3 first recognizes the 
selection of the VTRI so as to send to the VTRI a 
text reporting that the VTR1 Is selected. The text 
comprises, as shown in FIG. 3. a controller address 
as the own address, a VTR1 address as a destina- 
tion address, and VTRI selection information as a 
data field. 

When the text is received by the VTR1, the 
terminal control section (63, .... or 6n) interprets the 
content of the text to decide an action to be next 
taken. In this case, for the slection of the VTRI. 
control is passed to a sequence to display a pic- 
ture necessary for the control of the VTRI on the 
display section 4 of the controller. 

Code data related to the picture is first ob- 
tained from the screen constituent information 
keeping section{61. or n1) storing therein codes 
associated with pictures to be displayed. 

FIG. 4 shows a display example of a picture 
including only characters, whereas FIG. 5 is a 
schematic diagram showing a text transmitted from 
the VTR1 to the controller to construct the picture 
of FIG. 4. 

As can be seen from FIG. 5, the text comprises 



a VTRI address as the own address, a controller 
address as a destiantlon address, and a data field 
including code information items such as codes of 
characters and items related to a display color and 
5 a display position. In this data field of FIG. 5, 
portions or "P" and "L" of "PLAY" are shown. 
Naturally, for displaying character strings and 
grpahic images, the similar method is available. For 
example, as shown in FIG. 6. in a case where 
70 characters are to be displayed in rectangles, there 
is employed a text as shown In FIG. 7 including a 
code denoting a rectangle, X and Y coordinate 
values of the diagonal point, a tine color, etc. 

Subsequently, on receiving the text from the 
T5 VTRI. the controller interprets the text in the data 
processing section 33 of the control section 3 so as 
to get characters corresponding to the codes and a 
graphic image generating module from the picture 
data keeping section 31. The obtained data items 
20 are processed by the picture generating section 32 
to produce display data conforming to the display 
layout, thereby outputting the resultant data to the 
display section 4. 

Next, while visually checking the display pic- 
as ture (RG. 4 or 6) of VTRI thus displayed on the 
display section 4, the operator achieves a control 
operation from the input section 2. 

For example, when "PLAY" is selected, ac- 
cording to the sequence above, the controller 
30 sends a text of a code associated with "PLAY" to 
the VTRI. On receiving the text, the VTRI sets the 
own system to the "PLAY" state if possible. At the 
same time, in order to notify the condition of 
"PLAY" to the controller, the pertinent display in- 
35 formation is sent to the controller. 

For example, in a case where the color of 
"PLAY" currently being displayed is to be 
changed, a text as shown in FIG. 8 is transmitted to 
the controller in conformity with the sequence simi- 
lar to that described above. When this text is 



40 



received, the controller displays characters asso- 
ciated with the received code information items 
according to the similar procedure as employed 
above. The method of specifying the display con- 
45 tent has been described only by way of example. It 
is also possible to specify the display content at a 
time by use of character strings. 

On the other hand, when the VTRI is not 
loaded with a tape cassette for a playback opera- 
50 ton. the playback operation cannot be achieved. In 
such a situation, by keeping a guidance picture as 
shown in FIG. 9 in the picture constituent Informa- 
tion keeping sections (61 to 6n), the guidance 
picture can be displayed on the display section 4 
55 of the controller in the similar fashion. 

The response signals associated with the con- 
trol picture constitution and the guidance can be 
naturally produced in an arbitrary manner on the 
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terminal side. 

By repeately achieving the operations above, 
the operator can operate the terminal while visually 
checking the display screen. 

In accordance with the control system of this 
emt^odiment. the necessary picture information re- 
lated to the tenninals to be connected to the com- 
munication path need not be necessarily kept in 
the controller. The control system can flexibly cope 
with the increased in the number of tenminals and 
with functional modifications. 

Next, a description will be given of an embodi- 
ment in which a record reservation is conducted on 
a VTR as a terminal in the control system accord- 
ing.to the present invention. 

The VTR of this embodiment includes means 
for comparing a record period of time determined 
by inputted record start and end points of time and 
a remaining tape amount of a tape cassette in- 
stalled in the VTR. Depending on the results of the 
comparison, the means displays associated mes- 
sages. 

When the message is sent via the communica- 
tion route 5 to the controller, the message is dis- 
played on the display section 4. 

Consequently, also for the user operating at a 
remote terminal, such a message associated with 
the relationship between the record period of time 
and the remaining tape amount can be reported. 

FIG. 10 shows a system configuration in which 
a VTR having a record reserving function or a timer 
recording function Is connected to a communica- 
tion path. 

This constitution includes a terminal input sec- 
tion 11 for inputting a record point of time, a 
terminai control section 1 2. a VTR mechanism sec- 
tion 13, a remaining tape amount memory section 

14 for storing therein a remaining amount data (for 
the recording operation) of the tape cassette in- 
stalled in the VTR. a reserved time memory section 

15 for memorizing a record period of time deter- 
mined by the inputted record start and end points 
of time, a comparator section 16 for comparing the 
data of the remaining tape amount memory section 
14 with that of the reserved time memory section 
15, a display control section 17 for producing a 
message associated with the comparison result, 
and a display section 18. Namely, the VTR is 
constituted with the above components. 

Reference numerals 19 and 20 denote a com- 
munication control unit and a transmission path, 
respectively. 

The system further includes a control section 
21. an input section 22 comprising a remote control 
pad and the like, a display section 23. and an audio 
output section 24. That is. the controller is con- 
stituted with these components. 

The controller in this embodiment Is provided. 



in addition to the display section 23, with the audio 
output section 24 as output means. 

The VTR and the controller are connected via 
the communication control unit 19 to the commu- 
5 nication path 20. 

Next, a description will be given of operations 
of a remote control. 

The reserved record start and end points of 
time supplied from the input section 22 are re- 
7a ceived by the control section 21 so as to be 
transmitted via the communicatton control unit 19 
to the control section 12 as the transmission des- 
tination. 

The control section 12 computes a record pe- 

16 riod of time to store the result of the computation in 
the reserved time memory section 15. 

On the other hand, in the VTR, the remaining 
data (available record period of time) of the tape of 
the tape cassette installed In the VTR is measured 

20 to be memorized in the remaining tape amount 
memory section 14. The comparator section 16 
compares the data of the remaining tape amount 
memory section 14 with that of the reserved time 
memory section 15. Resultantly, the display control 

25 section 17 produces a message corresponding to 
the comparison result. 

The messsage is information concerning pic- 
ture constituent elements kept in the picture con- 
stituent element Information keeping section (not 

30 shown) integrated in the display control section 17. , 
The tenminal control section 12 sends the mes- 
sage via the communication control unit 9 to the 
controller. 

The control section 21 of the controller is re- 
35 sponsive to the received message to accomplish 
the following operations by use of display element 
infomnation kept in the screen data keep section 
(not shown) integrated in the control section ;*1. 

(1) When the remaining tape amount is 
.40 equal to or more than the reserved period of time. 

the control section 21 displays ''Reserved period of 
time is available for the recording", etc. 

(2) When the remaining tape amount is less 
than the reserved period of time, the control sec- 

45 tion 21 displays "XX hours are available for the 
recording. For the overall recording, install another 
tape cassette", etc. 

White particular embodiments of the invention 
have been shown and described, it will be obvious 

50 to those skilled in the art that various changes and 
modifications may be made without departing from 
the present invention in its broader aspects. 



55 Claims 

1. A apparatus control system using an on- 
screen display (4) including a controller (3) and a 
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plurality of terminal devices (6-n). each said termi- 
nal device being connected to a communication 
control unit (1) to a common communication path 
(5), said controller including: 

a display section (4); s 
an inpt section (2) for selecting control information 
related to a terminal device displayed on said dis- 
play section, thereby inputting the selected infor- 
mation; 

a control section (33) for processing the selected io 
information supplied form said input section to 
transmit a control signal associated with the se- 
lected information via said communication control 
unit to said terminal device and for receiving via 
said communication control unit information related 75 
to picture constituent elements from said terminal 
device to display on said diplay section a control 
screen based on the received content. 

2. An apparatus control system according to 
Claim 1 wherein each said terminal device includes so 
a picture constituent information keep section (61- 

n1) for keeping therein information related to pic- 
ture constituent elements for each display picture 
unit or for each partial display picture unit. 

3. An apparatus control system according to 25 
Claim 2 wherein said control section comprises a 
picture data keeping section (31) and a picture 
generating section (32). 

said picture data keeping section keeps display 
element information such as characters, basic pic- 30 
tures of a plurality of kinds, and image generating 
software module, 

said picture generating section generating, based 
on infonmation related to picture constituent ele- 
ments from the terminal device, a picture to be 35 
displayed by use of display element information 
kept in said picture data keeping section. 
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FIG. 2 
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FIG. 6 
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@ Apparatus control system using on-screen display. 



@ An apparatus control system in which a control- 
ler (3) and a plurality of terminal devices (6-n) are 
connected via the respective communication control 
units (1) to a common communication path (5). Each 
terminal device is provided with a picture constituent 
information keep section (61, .... or n1) for keeping 
information related to picture constituent elements 
for each display picture unit. The controller includes 
a picture data keeping section (31 ) for keeping dis- 
play element information such as characters, basic 



pictures of a plurality of kinds, and an image gen- 
erating software module so as to produce, based on 
the information related, to picure constituent ele- 
ments, a picture to be displayed by use of display 
element information. As a result, even when a new 
terminal Is connected to the system, a display pic- 
ture can be displayed for a control of the new 
terminal without requiring the controller to achieve a 
modification associted with the new terminal. 
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